Note: When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher.
Some full text articles may not yet be available without a charge during the embargo (administrative interval).
What is a DOI Number?
Some links on this page may take you to non-federal websites. Their policies may differ from this site.
-
Free, publicly-accessible full text available December 5, 2026
-
Free, publicly-accessible full text available November 1, 2026
-
Free, publicly-accessible full text available July 14, 2026
-
Free, publicly-accessible full text available August 1, 2026
-
Free, publicly-accessible full text available April 1, 2026
-
This work revisits the classical low-rank matrix factorization problem and unveils the critical role of initialization in shaping convergence rates for such nonconvex and nonsmooth optimization. We introduce Nystrom initialization, which significantly improves the global convergence of Scaled Gradient Descent (ScaledGD) in both symmetric and asymmetric matrix factorization tasks. Specifically, we prove that ScaledGD with Nystrom initialization achieves quadratic convergence in cases where only linear rates were previously known. Furthermore, we extend this initialization to low-rank adapters (LoRA) commonly used for finetuning foundation models. Our approach, NoRA, i.e., LoRA with Nystrom initialization, demonstrates superior performance across various downstream tasks and model scales, from 1B to 7B parameters, in large language and diffusion models.more » « less
-
Snow Water Equivalent dataset contains information about snow water equivalent (SWE), temperature, precipitation, wind speed, relative humidity, and related climate variables across different locations and time periods. It includes daily observations and derived variables for hydrological and climate analysis. An additional column, source, specifies the origin of each data column.more » « less
An official website of the United States government

Full Text Available